Co-evolutionary Learning in Liquid Architectures
نویسندگان
چکیده
A large class of problems requires real-time processing of complex temporal inputs in real-time. These are difficult tasks for state-of-the-art techniques, since they require capturing complex structures and relationships in massive quantities of low precision, ambiguous noisy data. A recentlyintroduced Liquid-State-Machine (LSM) paradigm provides a computational framework for applying a model of cortical neural microcircuit as a core computational unit in classification and recognition tasks of real-time temporal data. We extend the computational power of this framework by closing the loop. This is accomplished by applying, in parallel to the supervised learning of the readouts, a biologically-realistic learning within the framework of the microcircuit. This approach is inspired by neurobiological findings from exvivo multi-cellular electrical recordings and injection of dopamine to the neural culture. We show that by closing the loop we obtain a much more effective performance with the new Co-Evolutionary Liquid Architecture. We illustrate the added value of the closed-loop approach to liquid architectures by executing a speech recognition task.
منابع مشابه
Implementation of Evolutionary Algorithms for Deep Architectures
Deep learning is becoming an increasingly interesting and powerful machine learning method with successful applications in many domains, such as natural language processing, image recognition, and hand-written character recognition. Despite of its eminent success, limitations of traditional learning approach may still prevent deep learning from achieving a wide range of realistic learning tasks...
متن کاملCo-Evolving Cellular Architectures by Cellular Programming
| Recent studies have shown that non-uniform cellular automata (CA), where cellular rules need not necessarily be identical, can be co-evolved to perform computational tasks. This paper extends these studies by generalizing on a second aspect of CAs, namely their standard, homogeneous connectivity. We study non-standard architectures, where each cell has a small, identical number of connections...
متن کاملCo-evolving Architectures for Cellular Machines
Recent studies have shown that non-uniform cellular automata (CA), where cellular rules need not necessarily be identical, can be co-evolved to perform computational tasks. This paper extends these studies by generalizing on a second aspect of CAs, namely their standard, homogeneous connectivity. We study non-standard architectures, where each cell has a small, identical number of connections, ...
متن کاملEvolved Dual Weight Neural Architectures to Facilitate Incremental Learning
This paper explores techniques for improving incremental learning performance for generalization tasks. The idea is to generalize well from past input-output mappings that become available in batches over time, without the need to store past batches. Standard connectionist systems have previously been optimized for this problem using an evolutionary computation approach. Here that approach is e...
متن کاملNeuroevolution: from architectures to learning
Artificial neural networks (ANNs) are applied to many real-world problems, ranging from pattern classification to robot control. In order to design a neural network for a particular task, the choice of an architecture (including the choice of a neuron model), and the choice of a learning algorithm have to be addressed. Evolutionary search methods can provide an automatic solution to these probl...
متن کامل